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Our  work  on  perception-based  planning  and  execution  continues: 

♦  During  this  period,  we  made  substantial  progress  on  visual  tracking  for  our  mobile  robotic  system, 
and  upgraded  our  tracking  system  framework. 

We  have  begun  construction  of  a  navigation  system  for  our  mobile  robot  based  entirely  on  visual 
tracking.  During  this  period,  we  developed  SSD-based  tracking  systems,  and  used  those  systems 
to  demonstrate  robot  motion  along  a  pre- defined  path.  This  demonstration  included  automated 
selection  of  features  to  track  and  tracking  of  features  in  realtime  as  the  robot  moved.  We  are 
currently  working  on  extending  the  system  capabilities,  optimizing  the  tracking  functions,  and 
’’robustifying”  the  tracking  methods. 

We  have  extended  our  tracking  system  framework  in  a  number  of  ways.  Earlier  versions  of  the 
tracking  system  required  tracking  networks  to  be  strictly  heirarchical.  This  made  it  difficult  to 
share  features  among  different  system  components  requiring  visual  feedback.  The  new  system  eases 
this  heirarchical  requirement,  making  it  possible  to  have  more  fully  interconnected  networks.  We 
have  also  developed  a  typing  system  for  trackers,  making  it  possible  to  define  generical  geometric 
and  logical  constructions  independent  of  the  implementation  of  the  tracking  components.  These 
modifications  have  substantially  simplified  the  construction  of  visual  servoing  systems. 

#  We  continue  to  build  a  library  of  plans  and  transformations  for  our  work  on  sensor-guided  planning. 
The  current  work  focusses  on  getting  the  necessary  body  of  planning  knowledge  to  carry  out  our 
main  experiments.  For  this  purpose  we  are  implementing  failure  models  for  additional  kinds  of 
execution  failures  and  plan  revision  rules  indexed  by  these  failures. 

During  this  period  we 

—  developed  concepts  for  the  specification  of  deadlines  and  tenaporal  constraints  for  declarative 
goals.  RPL  will  be  extended  to  allow  for  the  following  kinds  of  declarative  goals: 

*  (ACHIEVE  g  BY  deadline) 

*  (MAINTAIN  s  OVER  interval) 

*  (STABILIZE  s  UNTIL  ti) 

—  compared  different  approaches  for  updating  the  world  model  of  the  robot.  The  question  is 
how  to  integrate  information  returned  by  sensing  routines  into  the  current  world  model  such 
that  the  world  model  is  consistent  with  the  robot^s  perceptions  and  actions  and  such  that 
most  observations  are  integrated  in  the  world  model. 

—  implemented  revision  rules  for  perceptual  confusion 

—  implemented  revision  rules  for  task  interferences 

—  implemented  revision  rules  for  deadlines 

•  In  the  course  of  trying  to  develop  a  pedagogical  framework  for  explaining  classical  planners,  we 
discovered  a  novel  technique  for  managing  means-ends  planning.  “Means-ends  planning’’  is  the 
process  of  adding  to  a  plan  feasible  actions  that  achieve  part  of  the  overall  goal.  There  is  an 
obvious  problem  here,  which  is  what  do  we  do  if  no  feasible  action  achieves  part  of  the  goal?  The 
standard  answer  is  to  make  subgoals  part  of  the  search  state,  and  provide  for  two  kinds  of  operator: 
adding  actions,  and  sprouting  subgoals.  The  alternative  we  explored  was  an  algorithm  that  finds 
at  one  go  all  actions  that  are  feasible  and  relevant  to  a  sub-sub-.  ..-subgoal  of  the  overall  goal. 
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This  algorithm  constructs  a  greedy  regression-match  graph,  which  keeps  track  of  both  (a)  the  best 
match  between  each  conjunctive  subgoal  and  the  current  situation,  and  (b)  all  actions  that  can 
achieve  a  goal  conjunct.  Preliminary  results  indicate  that  this  graph  provides  a  good  indicator  of 
the  best  action  to  take  first  in  pursuit  of  a  goal,  and  how  many  actions  will  remain  after  that. 
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Activities: 

Become  co-editor  of  a  special  section  of  IEEE  Trans.  Robotics  and  Automation  on  ’’vision-based 
motion  control.” 

Personnel  Support: 

•  Professors  (summer):  Drew  McDermott  and  Greg  Hager 

•  Graduate  Students  (full  time):  Michael  Beetz,  Aage  Bendikseii;  Kentaro  Toyama 

•  Post-doc  (half-time):  Hemant  Tagare 

•  Secretary  (half-time):  Paula  Murano 


Expenditures: 

The  accompanying  table  shows  the  figures  for  expenditures  to  date,  including  amounts  committed 
but  not  actually  spent. 

Overall  Status  and  Plans: 

We  are  pushing  toward  integration  of  our  robot-map  maintenance  work  with  our  visual-feature¬ 
tracking  work. 

We  are  (finally)  beginning  a  series  of  experiments  to  test  the  real-time  efficacy  of  pur  transformational 
planner. 
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